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(54) Automatic visual inspection apparatus, automatic visual inspection method, and recording 
medium having recorded an automatic visual inspection program 



(57) An image differential unit (2) differentiates an 
inspection image and a reference image on an object to 
be inspected. An image division unit (3) divides an im- 
age into a predetermined number of divisions. Pixel pre- 
cision position alignment unit (4) overlays the inspection 
image and the reference image by carrying out the po- 
sition alignment in pixel precision which is a pixel size 
precision. Function fitting unit (5) detects an edge, and 
obtains intensity profile of the absolute pixel value in the 
direction orthogonal with the edge, and fits a predeter- 
mined single peak function to it. Sub-pixel precision po- 
sition displacement computing unit (6) computes a dif- 
ference of the corresponding edge positions as the sub- 
pixel precision position displacement. Adjusted differen- 
tial image forming unit (7) forms the adjusted differential 
image by rewriting the pixel value so that the intensity 
profile of the pixel value in the direction orthogonal with 
the edge should follow the single peak type function 
form on the corresponding two edges. An image com- 
parison unit (8) detects the defect of the object to be 
inspected by comparing the adjusted divisional differen- 
tial image of the inspected image with the adjusted di- 
visional differential image of the reference image based 
on the position displacement of the sub-pixel precision. 
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Description 

Field of the invention 

[0001] The present invention relates to an automatic 
visual inspection apparatus, an automatic visual inspec- 
tion method and a recording medium having recorded 
the automatic visual inspection program. More particu- 
larly, the invention relates to an automatic visual inspec- 
tion technique adapted for the purpose of detecting the 
shape defect of the pattern in the photomask or reticule 
for lithography of a semiconductor device. 

Description of the Related Art 

[0002] In general, in the inspection step in the semi- 
conductor manufacturing, the shape defect of the pat- 
tern in the photomask or reticule for lithography of a 
semiconductor device is inspected by using an image. 
[0003] As the representative procedures for detecting 
the shape defect of the pattern by using an image, there 
are die-to-die system for making comparison by the ad- 
jacent chip and the template matting and the die to da- 
tabase system for forming a reference image by the 
CAD data and making comparison with it, as disclosed 
in U.S. Patent No. 4,805,123, Feb. 14, 1989 of Donald 
R Specht et al., "Automatic Photomask and Reticule In- 
spection Method and Apparatus including Improved De- 
fect Detector and Alignment Sub-Systems". As these 
procedures are simple and relatively small calculation 
amount, similar procedures are adopted in various au- 
tomatic visual inspection apparatuses. 
[0004] Japanese Patent Application Laid-Open No. 
7-63691 discloses a pattern defect inspection method 
and its apparatus for detecting the pattern defect of the 
member to be inspected by detecting an edge direction 
in the reference image data for detecting the pattern de- 
fect of the an object to be inspected, applying the differ- 
ential processing respectively to the reference image 
data and the inspection image data obtained by picking 
up the image of the object to be inspected according to 
the edge direction, comparing the reference image data 
which has been subjected to the differential processing 
and the inspection image data, and detecting the pattern 
defect from the difference of the image data between 
them. 

[0005] According to the procedure of Donald F. 
Specht et ah, when : for example, there is a defect of 
lacking in a corner in the inspection image as shown in 
Fig. 1 , alignment is carried out by a template matching 
with the reference image of Fig. 1 B, there may be a case 
where the images are overlaid together to make the 
edge parts agree as in Fig. 1C and a case where the 
images are overlaid together with the edge parts dis- 
placed as in Fig. 1 D. In a case that the images are over- 
laid together with full agreement of the edge parts, the 
difference of the two images are only in the corner in 
which the defect actually exists, and no false defect oc- 



curs. However, when the images are overlaid with dis- 
placement of the edge parts as in Fig. 1 D, false defects 
occur in the edge part. 

[0006] Further, as shown in Fig. 2A (a graph showing 
s the variation of intensity of the image to be inspected) 
and in Fig. 2B (a graph showing the variation of intensity 
of the reference image), in a case that the variation of 
the intensity of the edge part differs between the inspec- 
tion image and the reference image due to the difference 
to of manufacturing step or image pickup conditions, a 
false defect occurs in making comparison between the 
two images as shown in Fig. 2C. 
[0007] Furthermore, as shown in Fig. 3A (a graph 
showing the variation of intensity of the image to be in- 

*s spected) and in Fig. 3B (a graph showing the variation 
of intensity of the reference image), in a case that a dif- 
ference arises in the size of offset between the image 
to be inspected and the reference image, or, as shown 
in Fig. 4A (a graph showing the variation of intensity of 

20 the image to be inspected) and in Fig. 4B (a graph show- 
ing the variation of intensity of the reference image), in 
a case that a difference occurs in the intensity under ef- 
fect of the difference of gains of the detector or the in- 
tensity of the light source, there occurs a false defect. 

2S [0008] Furthermore, according to the procedure of 
Donald F Specht, et. al., in aligning the positions of the 
images to be compared, a intensity between the pixels 
is interpolated to one image to form an image with dis- 
placement of a sub-pixel in position, and alignment of a 

30 sub-pixel precision was made. Because of this, in a case 
that of making alignment in high precision, it is neces- 
sary to produce a large quantity of the images having 
delicate degrees of the position displacements for com- 
parison, so that there has been a problem to require an 

35 enormous amount of calculations and memory capacity 
for the purpose. 

[0009] On the other hand, according to the pattern de- 
fect inspection method and its apparatus as disclosed 
in Japanese Patent Application Laid-Open No. 

40 7-673691 , it is told that, even if there are some displace- 
ments of coordinates between the coordinate of the in- 
spection image data of the inspection pattern and the 
reference image data of the reference pattern, it is pos- 
sible to prevent generation of false defect and to detect 

45 securely the pattern defect only. However, the publica- 
tion does not show the technical matters corresponding 
to the present invention as to the method of alignment 
of the images nor any description suggestive of it. 
[0010] An object of the present invention is to provide 

50 an automatic visual inspection apparatus, an automatic 
visual inspection method and a recording medium hav- 
ing recorded the automatic visual inspection program 
with which generation of false defect is prevented and 
there is no increase in the necessary calculation amount 

55 or memory capacity even when the precision of align- 
ment is elevated. 

[0011] In the automatic visual inspection apparatus of 
the present invention, an image division differential unit 
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inputs an inspection image on the object to be inspected 
and a reference image for making comparison with the 
inspection image, and spatially differentiating the re- 
spective inputted images and dividing them into the pre- 
determined number of divisions to form the divisional dif- 
ferential images. A pixel precision alignment unit over- 
lays the inspection image on the reference image by car- 
rying out the position alignment in pixel precision which 
is a pixel size precision between the inspection image 
and the reference image on each of the divisional differ- 
ential image formed by the image division differential 
unit. A function fitting unit regards the point where the 
absolute pixel value is larger than the predetermined 
threshold value to be an edge in each divisional differ- 
ential image, obtaining the direction of the edge, obtain- 
ing the distribution of the intensity of the absolute pixel 
value in the direction orthogonal with the edge, fitting a 
predetermined single peak function to it. obtaining the 
maximum value point which is a coordinate of the point 
where its function takes the maximum value by a sub- 
pixel precision which is the precision lower than the pixel 
size, and employing the resulting value as coordinate of 
an edge. A sub-pixel precision position displacement 
computing unit obtains a position displacement of the 
sub-pixel precision. After the laying over of the images 
together in the pixel precision position aligning unit, if, 
there is an edge in the region on the reference image 
corresponding to the neighborhood of the edge, these 
two edges are regarded as being in the corresponding 
relations, and said sub-pixel precision position displace- 
ment computing unit computes the difference of the mu- 
tual edge positions as a position displacement of the 
sub-pixel precision. An adjusted differential image form- 
ing unit forms the adjusted differential image by rewriting 
the pixel value so that the intensity profile of the pixel 
value in the direction orthogonal with the edge should 
follow the previously given single peak type function 
form on the corresponding two edges. An image com- 
parison unit detects the defect of the object to be in- 
spected by comparing the adjusted divisional differential 
image of the inspected image with the adjusted division- 
al differential image of the reference image based on 
the position displacement of the sub-pixel precision of 
each divisional differential image computed by the sub- 
pixel precision position displacement computing unit. 
[0012] The above sub-pixel precision position dis- 
placement computing unit may compute the average 
value of the position displacement in sub-pixel precision 
in all edges in one divisional differential image as the 
position displacement of the sub-pixel precision of the 
divisional differential image. 

[0013] The above image comparison unit may obtain 
the absolute pixel value showing the d iff ere nee. bet ween 
the adjusted divisional differential image of the inspec- 
tion image arid the adjusted divisional differentia! image 
of the reference image, and in a case that the resulting 
value exceeds the predetermined threshold value, the 
unit regards the result to be the defect of the inspected 



object. 

[0014] The above image comparison unit may form 
the adjusted divisional differential image having the po- 
sition displacement by a sub-pixel by interpolating the 

5 intensity between the pixels in either one of the adjusted 
divisional differential image, and compare it with the oth- 
er adjusted differential image. 
[0015] The above sub-pixel precision position dis- 
placement computing unit may detect a corner on the 

10 divisional differential image, and if a corner exists, the 
unit effect laying over the images in the pixel precision 
position alignment unit, after which, if, with respect to 
the certain comer on the inspected image, there is a cor- 
ner in the region on the reference image corresponding 

is to the nearest part to the corner, these two corners are 
regarded to be in corresponding relations, and the dif- 
ference of the mutual corner positions may be computed 
as the position displacement of the sub-pixel precision 
between the corners. 

20 [0016] The automatic visual inspection method of the 
present invention has the following steps. 

(1 ) an inspection image on the object to be inspect- 
ed and a reference image for making comparison 

25 with the inspection image are inputted, and the re- 
spective inputted images are spatially differentiated 
to form the differentiated images; 

(2) according to the predetermined number of divi- 
sions, the formed differential images and forming 

30 the divisional differential images are divided; 

(3) the inspection image on the reference image by 
carrying out the position alignment in pixel precision 
which is a pixel size precision between the inspec- 
tion image and the reference image on each formed 

35 divisional differential image are overlaid; 

(4) in each divisional differential image, the point 
where the absolute pixel value is larger than the pre- 
determined threshold value to is regarded to be an 
edge in each divisional differential image; the direc- 

40 tion of the edge is obtained; distribution of the in- 
tensity of the absolute pixel value is obtained in the 
direction orthogonal with the edge; a predetermined 
single peak function is fitted to it; the maximum val- 
ue point which is a coordinate of the point where its 

45 function takes the maximum value is obtained by a 
sub-pixel precision which isthe precision lowerthan 
the pixel size; and the resulting value is employed 
as coordinate of an edge; 

(5) after the mutual laying over of the images, if, on 
so certain edge on the inspection image, there is an 

edge in the region on the reference image corre- 
sponding to the neighborhood of the edge, these 
two edges are regarded as being in the correspond- 
ing relations, and the difference of the mutual edge 
55 positions is computed as a position displacement of 
the sub-pixel precision; 

(6) an adjusted differential image is formed by re- 
writing the pixel value so that the intensity profile of 
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the pixel value in the direction orthogonal with the 
edge should follow the previously given single peak 
type function form on the corresponding two edges; 
(7) the defect of the object to be inspected is detect- 
ed by comparing the adjusted divisional differential 
image of the inspected image with the adjusted di- 
visional differential image of the reference image 
based on the position displacement of the sub-pixel 
precision of each divisional differential image com- 
puted. 

[0017] The automatic visual inspection method of the 
present invention may be performed by replacing the se- 
quence of the above step (1 ) and step (2) such that the 
input image is divided f i rst and then differentiated to form 
a divisional differential image. 

[0018] The recording medium of the present invention 
is characterized by having recorded a program for caus- 
ing a computer to execute said method. 
[0019] The present invention having the constitution 
as described above has the following effects: 

(1) In the present invention, the edge position is 
detected in the sub-pixel precision, and the inspection 
image and the reference image which are to be com- 
pared based on the detected edge position are position 
aligned in sub-pixel precision, and in comparing the im- 
ages after alignment, the intensity profile of the corre- 
sponding edges are modified into the same shape. 
[0020] Accordingly, because of the position alignment 
made between the edges, even when defects exist in a 
corner part, there is less tendency for false defect to oc- 
cur in the edge part in the vicinity of the corner part. 
[0021] Further, in the differential images to be com- 
pared, the intensity profile of the corresponding edge 
portions are modified into the same shape, so that even 
if the intensity gradients in the vicinity of the edges differ 
between the images to be compared, a false defect is 
less caused to occur. 

[0022] Moreover, since the offset which is a DC com- 
ponent in image is lost by differentiation, a false defect 
is less caused to occur even when the offsets differ be- 
. tween the images to be compared. 
[0023] Furthermore, since the intensity profile of the 
corresponding edge portions is modified into the same 
shape, even if the gains of the detector or the intensity 
of illumination differ between the images, false defects 
are less caused to occur. 

[0024] Also, in a case of comparing the edge images, 
even if the real edge positions differ by about the sub- 
pixel, usually the difference on the edge image becomes 
more than one pixel to become the cause for the false 
defect. However, in a case of comparing the modified 
images following the given function forms as in the 
present invention, even if the edge positions of the sub- 
pixels differ, due to the small difference of the pixel val- 
ues, a false defect is less caused to occur. 
[0025] As reviewed above, since in the present inven- 
tion generation of the false defects can be prevented, 



highly reliable automatic visual inspection can be car- 
ried out. 

(2) In the present invention, due to the computa- 
. tion of the position displacement ol the sub-pixel preci- 
s sion on each divisional differential image by obtaining 
the distance of the corresponding edges between the 
images to be compared, there is no necessity to make 
comparison by forming a magnified images. According- 
ly, even if the precision of position alignment is elevated, 
io no increase in the necessary calculation amount or 
memory capacity is required. 

Figs. 1 A through 1D are illustrative views for ex- 
plaining an example of false defect detection at the 
is edge portion in the vicinity of the corner, in the con- 
ventional method; 

Figs. 2A through 2C are graphs for explaining an 
example for detecting the false defect in the case 
where the intensity gradients in the portions near 
20 the edge differ between the images to be compared, 
in the conventional procedures; 
Figs. 3 A and 3B are graphs for illustrating an exam- 
ple of the false defect detection in the case of the 
difference of the offsets between the images to be 
25 compared , in the conventional method; 

Figs. 4 A and 4B are graphs for illustrating an exam- 
ple of the false defect detection in the case of the 
difference in the gain of the detectors or in the in- 
tensity of the illumination, between the images to be 
30 compared, in the conventional method; 

Figs. 5A through 5C are illustrative views for illus- 
trating the case where, even if the edge positions 
are different by about a sub-pixel, there may be cas- 
es where the difference occurs by 1 pixel on the 
35 edge image; 

Fig. 6 is a block diagram showing the constitution 
of the first and the second embodiments of the 
present invention; 

Fig. 7 is a block diagram showing the constitution 

40 of the third embodiment of the present invention; 

Fig. 8A is an illustrative view. showing an input im- 
age, Fig.8B is an illustrative view showing a vertical 
differential image, and Fig.8C is an illustrative view 
showing a horizontal differential image; and Fig.8D 

45 is an illustrative view showing the function fitting in 
the horizontal direction to the vertical edge; 
Fig. 9A is an illustrative view showing an input im- 
age, Fig.9B is an illustrative view showing a vertical 
differential image, and Fig. 9C is an illustrative view 

so showing a horizontal differential image; 

Fig. 1 0A is an illustrative view showing a vertical dif- 
ferential image of the inspection image, Fig. 1 0B is 
an illustrative view showing a vertical differential im- 
age of the reference image, Fig.lOC is an illustrative 

55 view showing the condition where the vertical differ- 
ential image of the inspection image and the vertical 
differential image of the reference image are mutu- 
ally position aligned in pixel precision, and Fig.lOD 
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is an enlarged view of the part S in 10C; 
Fig. 11 A is an illustrative view showing the position- 
al displacement between the edge on the inspection 
image and the edge on the reference image, and 
Fig.HB is an illustrative view showing the condition 
of the inspection image displaced horizontally by 
dx, and vertically by dy; 

Fig. 1 2A is an illustrative view showing the position- 
al displacement between the edge on the inspection 
image and the edge on the reference image, Fig. 
1 2B is an enlarged view made by enlarging the area 
near the point e in 1.2 A, and Fig.12C is an illustrative 
view showing the true horizontal position displace- 
ment dx' and the true vertical position displacement 
dy'; 

Fig. 13A is an illustrative view showing an input im- 
age, and Fig.1 3B is an illustrative view showing the 
total differential image obtained by adding a square 
of the vertical differential image and a square of the 
horizontal differential image, and taking the square 
root thereof; 

Fig. 14 is a graph showing the variation of the in- 
tensity of the coordinates wherein the ordinate is a 
coordinate, and the abscissa is a differential inten- 
sity, and a function of a single peak property in the 
differential image; 

Figs. 15A and 15B are illustrative views illustrating 
the case of interpolating the intensity between the 
pixels to obtain the distribution of concentrations in 
a direction orthogonal with the edge; and 
Figs. 1 6A and 1 6B are illustrative views for illustrat- 
ing the position alignment using a corner; and 16B 
is an enlarged view of the corner K. 

[0026] Hereinafter, preferred embodiments of the 
present invention are described with reference to the ap- 
pended drawings. Fig. 6 is a block diagram showing an 
automatic visual inspection apparatus according to the 
embodiment of the present invention. 
[0027] The automatic visual inspection apparatus 20 
of this embodiment invention is used to detect the pat- 
tern shape defect of an object to be inspected (e.g., 
semiconductor wafer, substrate, photomask, reticule, 
liquid crystal, etc.) by using an image. As shown in Figs. 
6, the automatic visual inspection apparatus 20 of the 
present invention has an image processor 9 for image 
processing the inspection image of the object to be in- 
spected inputted from the external image input appara- 
tus 1 such as an image pickup camera and comparing 
it with the reference image. 

[0028] The image processor 9 has an image differen- 
tial unit 2, an image division unit 3, a pixel precision po- 
sition alignment unit 4, a function fitting unit 5, a sub- 
pixel precision position displacement calculating unit 6, 
an adjusted differential image forming unit 7, and an im- 
age comparison unit 8. 

[0029] The image differential unit 2 lakes one of the 
two images to be compared inputted from the external 



image input device 1 to be an inspection image which 
should be an objective image of the object to be inspect- 
ed, and the other to be a reference image which should 
be compared with the inspection image. Each image is 
5 provided spatially with differentiation to form a differen- 
tial image. 

[0030] The image division unit 3 divides the differen- 
tial image according to the predetermined number of di- 
visions and size of the overlapping part with the adjacent 

10 image and forms the divisional differential image. 

[0031] The pixel precision position alignment unit 4 
carries out position alignment in the pixel size precision 
or pixel precision between the inspection image and the 
reference image in the unit of the divisional differential 

is image to lay together the inspection image and the ref- 
erence image. 

[0032] The function fitting unit 5 regards the point at 
which the absolute pixel value is larger than the prede- 
termined threshold value to be an edge in each division- 

20 at differential image, obtains a direction of the edge, ob- 
tains an intensity profile of the absolute value in respect 
to the direction orthogonal with the edge, applies to fit 
the predetermined single peak function to it, and obtains 
the maximum value point which is a coordinate of the 

2S point at which the function takes the maximum value in 
a sub-pixel precision which is a precision lower than the 
pixel size to take it as a coordinate for the edge. 
[0033] The sub-pixel precision position displacement 
computing unit 6, after the overlaying of the images to- 

30 gether in the pixel precision position alignment unit 4, 
takes that, with respect to a certain edge on the inspec- 
• tion image, if there is an edge in the region on a refer- 
ence image corresponding to the neighborhood of the 
edge, these two edges are in corresponding relations, 

35 by which the difference of the mutual edge positions is 
regarded to be the displacement of the position in sub- 
pixel precision, so that the average value of the position 
displacement in sub-pixel precision of the whole edges 
in one divisional differential image is computed as a po- 

40 sition displacement in sub-pixel precision. 

[0034] The adjusted differential image forming unit 7 
forms an adjusted differential image on the two edges 
which have been set to correspond by rewriting the pixel 
value in conformity with the predetermined single peak 

45 function form for the concentration distribution of the pix- 
el value in the direction orthogonal with the edge. 
[0035] The image comparison unit 8 compares the 
positions of the differential images by overlaying them 
in a sub-pixel precision based on the position displace- 

so rnent of the divisional differential image in sub-pixel pre- 
cision, and in a case that there is a point which exceeds 
the predetermined threshold value in the difference, 
such point is regarded to be the defect of the object un- 
der inspection. 

55 [0036] To the automatic visual inspection apparatus 
20 of the present invention there are connected a pa- 
rameter input apparatus 10 including a keyboard, ten- 
key, mouse, etc. for setting the number of divisions for 
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dividing the image, threshold value, etc., an output ap- 
paratus 11 including a display, a printer, etc. for display- 
ing the images, defective spot, etc., and a memory unit 
1 2 for memorizing various kinds of data. 
[0037] Next, the operation of the automatic visual in- 5 
spection apparatus 20 of the present invention is illus- 
trated. 

[0038] Firstly, the image differential unit 2 sets one of 
the two inputted images from the image input apparatus 
1 to be an inspection image, and the other to be a ret- 10 
erence image, and by convoluting for example a SOBEL 
filter in each image, the respective differential images in 
vertical and horizontal directions are formed as the ver- 
tical differential image and horizontal differential image, 
thereby forming the total differential image having the 
square root of the sum of the square of each pixel value 
in the vertical and horizontal differential images. 
[0039] For example, when an image as shown in Fig. 
8A is inputted, by carrying out vertical differentiation a 
horizontal edge is obtained as shown in Fig 8B, and by 
carrying out horizontal differentiation a vertical edge is 
obtained as shown in Fig. 8C. Also, in a case that an 
image as shown in Fig. 9A is inputted by carrying out 
vertical differentiation a slanting edge as shown in Fig. 
9B is obtained, and by carrying out horizontal differen- 
tiation a slanting edge as shown in Fig. 9C is obtained. 
[0040] Next, the image division unit 3 divides the ver- 
tical and horizontal differential image and the total dif- 
ferential image according to the predetermined number 
of divisions and the size of the overlaying of images with 
the adjacent image to make the respective images into 
divisional vertical differential image, divisional horizon- 
tal differential image, and divisional total differential im- 
age. The division of image is of course exchangeable 
with the image differentiation such that at first the input 
image may be divided by the image division unit 3 and 
differentiated by the image differentiation unit 2 to form 
a divisional vertical differential image, a divisional hori- 
zontal differential image, and a divisional total differen- 
tial image. 

[0041] Next, the pixel precision position alignment 
unit 4 effects overlaying of the inspection image and the 
reference image by performing position setting in pixel 
size precision by carrying out for example a template 
matting between the inspection image and the reference 
image on each divisional total differential image. 
[0042] Next, the function fitting unit 5 regards the pixel 
in which the absolute pixel value of the divisional total 
differential image and the pixel values of the respective 
divisional vertical differential images are larger than the 
predetermined threshold value to be an edge in each 
divisional vertical differential image, obtains an intensity 
profile of the absolute pixel value in the vertical direction 
to the horizontal edge appearing on the divisional verti- 
cal differential image, applies to fit the predetermined 
single peak function to it, and obtains the maximum val- 
ue point which is a coordinate of the point at which the 
function takes the maximum value in a sub-pixel preci- 



sion which is a precision lower than the pixel size to take 
it as a vertical direction coordinate for the edge. 
[0043] With respect to the divisional horizontal differ- 
ential image, a single peak function is fitted to the verti- 
cal edge appearing on the divisional vertical differential 
image, and the maximum value point is obtained in a 
sub-pixel precision, which is taken as a horizontal direc- 
tion coordinate for the edge. 

[0044] For example, when a horizontal differentiation 
is applied to the input image as shown in Fig. 8A and a 
vertical edge as shown in Fig. 8D is obtained, a function 
fitting is carried out to the vertical edge in the horizontal 
direction (arrow mark direction). 
[0045] Intensity of the horizontal differential image (an 
absolute value of the horizontal differential intensity of 
the input image) becomes, in the neighborhood of the 
zone in which an edge is present, as shown in Fig. 14. 
To it, a single peak type function is fitted. Here, by the 
term of single peak type function is meant, as shown in 
Fig. 14, a function which is convex on a point on which 
the point to take the maximum value is only one. Also, 
the fitting procedure includes a least square method as 
a representative one, but the method is not limited to it. 
With respect to the case of the vertical differential image, 
the direction of differentiation, the direction of the edge, 
and the direction of the function fitting become all verti- 
cal to the case of the horizontal differential image, but 
basically the function fitting is carried out in the similar 
manner. 

[0046] The sub-pixel precision position displacement 
computing unit 6, after the overlaying of the images to- 
gether in the pixel precision position alignment unit 4, 
takes that, with respect to a certain edge on the division- 
al vertical differential image of the inspection image, if 
there is an edge on the same coordinate on the division- 
al horizontal differential image of the inspection image, 
then the edge is regarded to be a horizontal edge, and 
if there is an edge in the region on the divisional vertical 
differential image of the corresponding reference image 
in the vicinity of the edge on the divisional vertical dif- 
ferential image of the inspection image, such two edges 
are regarded to be in corresponding relations, by which 
the difference of the mutual edge positions is regarded 
to be the displacement of the position in sub-pixel pre- 
cision. 

[0047] If, on certain edge on the divisional horizontal 
differential image of an inspection image, there is no 
edge in the same coordinate on the divisional vertical 
differential image of the inspection image, the the edge 
is regarded to be a vertical edge, to which the same op- 
eration as in the case of the horizontal edge is applied 
to obtain position displacement in sub-pixel precision in 
the horizontal direction of the vertical edge in the corre- 
sponding relations. If, with respect to certain edge on 
the divisional vertical differential image of the inspection 
image, there is also an edge on the same coordinate on 
the divisional horizontal differential image of the inspec- 
tion image, the edge is regarded to be a slanting edge. 



20 



25 



30 



35 



40 



45 



50 



6 



11 



EP 0 930 499 A1 



12 



[0048] For example, in a case of the input image as 
shown in Fig. 8A, with respect to the point which in- 
cludes a horizontal edge on a vertical differential divi- 
sional image shown in Fig. 8B, namely, on the portion 
in which the vertical differential precision is strong, e.g., s 
on the point a, the corresponding point a 1 is viewed by 
a horizontal differential image as shown in Fig. 8C, the 
horizontal differential intensity is not strong, without hav- 
ing an edge. That is to say, if, on the point a having the 
strong differential intensity in the vertical differential im- 10 
age, the differential intensity of the point on the horizon- 
tal differential image corresponding thereto is weak ; the 
point a can be concluded as a point which constitutes a 
horizontal edge. Similarly, with respect to the point hav- 
ing strong differential intensity in the horizontal differen- is 
tial image, if the differential intensity of the point on the 
vertical differential image corresponding thereto is 
weak, then the point can be concluded as being a point 
which constitutes a vertical edge. 

[0049] In the case of the input image as shown in Fig. 20 
9A, the shapes of the edges on the vertical differential 
image as shown in Fig. 9B and on the horizontal differ- 
ential image as shown in Fig. 9C are similar to each oth- 
er. However, the pixel values of the respective images 
(i.e., the differential intensity of vertical differentiation 25 
and the differential intensity of horizontal differentiation) 
generally take the different values. Here, observing the 
point b having the strong vertical differential intensity on 
the vertical differential image as shown in Fig. 9B, the 
horizontal differentiation intensity ol the point b' on the 30 
horizontal differential image as shown in Fig. 9C corre- 
sponding to the point is strong (the value is larger than 
the threshold value). Namely, if, with respect to a certain 
point having strong differential intensity on a vertical dif- 
ferential image, the horizontal differential intensity on a 35 
horizontal differential image corresponding thereto is 
strong, such point can be concluded as being a point to 
constitute a slanting edge. 

[0050] If there is an edge in a region on a divisional 
vertical differential image of a reference image corre- 40 
sponding to the neighborhood of the edge of the divi- 
sional vertical differential image of the inspection image, 
or there is an edge in a region on a divisional horizontal 
differential irhage of a reference image corresponding 
to the nearest part of the edge of the divisional horizontal 
differential image of the inspection image, then these 
two edges are regarded to be in corresponding rela- 
tions, and the difference of the mutual edge positions is 
taken as a position displacement in sub-pixel compo- 
nents in the direction orthogonal with the edge of mutual so 
edges, and the position displacement is decomposed 
into the vertical direction component and the horizontal 
direction component. 

[0051] With respect to the position displacement in 
sub-pixel precision of whole edges in a divisional vertical 55 
differential image and a divisional horizontal differential 
image corresponding thereto, average values of the re- 
spective components in the horizontal direction and in 



the vertical direction are obtained, respectively, and they 
are taken as the vertical directional position displace- 
ment and the horizontal directional position displace- 
ment of the sub-pixel precision of the respective divi- 
sional total differential image. 
[0052] For example, when the vertical differential im- 
age of the inspection image as shown in Fig. 10A and 
the vertical differential image of the reference image as 
shown in Fig. 10B are subjected to position alignment 
in a pixel precision, the result becomes as shown in Fig. 
1 0C. Fig. 1 0D is an enlarged view in which the part S in 
Fig. 10C is enlarged. As shown in Fig. 10D, with respect 
to the point c having the large vertical differential inten- 
sity on the vertical differential image of the inspection 
image, the points having large intensity of vertical differ- 
ential intensity are searched on the vertical differential 
image of the reference image in the vicinity of the point 
on a reference image, and if a plurality of such points 
have been detected, the point d which is nearest to the 
point c out of them is regarded to be the point corre- 
sponding to the point c. Both the coordinate of the point 
c and the coordinate of the point d are determined by 
the sub-pixel precision in the vertical direction, and 
when the difference of these positions is to be taken as 
the size of the position displacement of the two images, 
the position displacement of the two edges is to be de- 
termined by the sub-pixel precision. Such operation is 
obtained on all the points having strong vertical differ- 
ential intensity on the subject image, an average value 
of the position displacements in sub-pixel precision is 
obtained, which is to be taken finally as a position dis- 
placement of the sub-pixel precision in vertical direction 
of the two images. 

[0053] In the case of the vertical edge, a position dis- 
placement of the sub-pixel precision in the horizontal di- 
rection is obtained in the same manner. In the case of 
the slanting edge, similarly, the position displacements 
of the reference image and the inspection image are ob- 
tained in the unit of the vertical differential image and 
the horizontal differential image. However, as shown in 
Fig.ltA, assuming the horizontal position displacement 
to be dx and the vertical position displacement to be dy, 
it does not follow that the dx and dy become in straight 
manner the position displacements of the inspection im- 
age and the reference image. If, as shown in Fig. 11 B, 
the inspection image is shifted by dx horizontally, and 
dy vertically, then excessive displacements occur. 
[0054] Accordingly, assuming that, as shown in Fig. 
12A, the position displacement of the point e shown in 
Fig. 11 A is in the direction vertical to the edge, the po- 
sition displacement t in the vertical direction of the edge 
is obtained from dx and dy. The drawing which shows 
the zone near the point e by enlargement is Fig. 12B. 
The following expression 1 is obtainable from Fig. 1 2B: 

t 2 = 1/(1/dx 2 + 1/dy 2 ) (1) 
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where, tanG = dy/dx. 

[0055] The true position displacement in the horizon- 
tal direction dx 1 and the true position displacement in the 
vertical direction dy* to be obtained are obtainable by 
substituting the expression 1 into the following expres- 
sion 2. 

dx' =t sine = t 2 /dx 

dy' = t cose = t 2 /dy (2) 

[0056] Next, the adjusted differential image formation 
unit 7 forms an adjusted divisional vertical differential 
image by rewriting the pixel value so that the intensity 
profile in vertical direction conforms to the predeter- 
mined same single peak type function shape on two hor- 
izontal edges which have been correspondingly related 
on the divisional vertical differential image of the inspec- 
tion image and the divisional vertical differential image 
of the reference image. With respect to the divisional 
horizontal differential image, an adjusted divisional hor- 
izontal differential image is formed by similarly rewriting 
the pixel value so that the intensity profile in horizontal 
direction of the vertical edge conforms to the predeter- 
mined same single peak type function shape. And, an 
adjusted divisional total differential image having as a 
pixel a square root of the square sum of the pixel values 
of the adjusted divisional vertical differential image and 
the adjusted divisional horizontal differential image is 
obtained. 

[0057] Next, the image comparison unit 8 forms an 
adjusted divisional total differential image having posi- 
tion displacement by a sub-pixel by interpolating the in- 
tensity between the pixels in an adjusted divisional total 
differential image of either the inspection image or the 
reference image based on the position displacement of 
sub-pixel precision in each direction of vertical and hor- 
izontal in each divisional total differential image, over- 
lays it with the other, and obtains for example an abso- 
lute value of the difference of the pixel values by the ad- 
justed divisional total differential image of the inspection 
image and the adjusted divisional total differential image 
of the reference image, and in a case that there is found 
a point in which the obtained value exceeds the prede- 
termined threshold value, such is regarded to be the de- 
fect. The coordinate of the defect spot is either displayed 
by an output device 11 or memorized in a memory de- 
vice 12. 

[0058] Next, the second embodiment of the present 
invention is described with reference to the drawings. 
[0059] In the second embodiment, an image input ap- 
paratus 1 , an image differential unit 2, an image division 
unit 3, a pixel precision position alignment unit 4, and 
an image comparison unit 8 show the same actions as 
those of the first embodiment. 

[0060] In the second embodiment, the function fitting 



unit 5 regards the pixel of which the absolute value is 
larger than the predetermined threshold value to be an 
edge in each divisional differential image, taking, for ex- 
ample, an arctangent of the ratio of the pixel value of the 

s vertical differential image to the horizontal differential 
pixel in the image differential unit 2 to be the direction 
of its edge, and obtains an intensity profile of the abso- 
lute value in respect to the direction orthogonal with the 
edge, then fits the predetermined single peak function 

10 to the obtained intensity profile, and obtains the maxi- 
mum value point which is a coordinate of the point at 
which the function takes the maximum value in a sub- 
pixel precision which is a precision lower than the pixel 
size to take it as a coordinate for the edge. 

is [0061] For example, by an existing procedure using 
SOBEL filter, the direction of the edge is obtained from 
the vertical differential image and the horizontal differ- 
ential image of the input image shown in Fig.13A(ref. 
Fig. 1 3B). Fig. 1 3B shows a total differential image ob- 

20 tained by adding the square of the vertical differential 
image and the square of the horizontal differential image 
and obtaining the square root thereof. And, an intensity 
profile is obtained in the direction orthogonal with the 
obtained edge direction, to which function fitting is per- 

2B formed with a single peak type function (ref. Fig. 14) to 
obtain the edge position. 

[0062] Also, in the second embodiment, the sub-pixel 
precision position displacement computing unit 6 takes 
for example the portion in which the curvature of the 
30 edge is larger than the predetermined threshold value 
in the divisional total differential image to be a comer, 
and if a corner exists, after overlaying the images to- 
gether in the pixel precision position alignment unit 4, 
takes that, with respect to a certain corner on the inspec- 
ts tion image, if there is a corner in the region on a refer- 
ence image corresponding to the neighborhood of the 
corner, these two corners are in corresponding rela- 
tions, by which the difference of the mutual corner po- 
sitions is regarded to be the displacement of the position 
40 in sub-pixel precision, the position displacement is sep- 
arated into the vertical direction and the horizontal di- 
rection, so that the average value of the position dis- 
placement in sub-pixel precision of the whole corners in 
one divisional total differential image is obtained inde- 
x's pendently on vertical and horizontal directions, and they 
are taken as position displacements in sub-pixel preci- 
sion of the divisional total differential image. 
[0063] Also, the edges adjacent to the corners in the 
corresponding relations on the two images are regarded 
so to be in the corresponding relations. 

[0064] For example, as shown in Fig. 1 6A, a comer K 
is detected by a conventional procedure such as to take 
the point at which the curvature variation of the edge is 
large to be the corner. Since the comer position has 
55 been obtained by the sub-pixel precision, as shown in 
Fig. 16B, the coordinate of the corner which is a crossing 
point of the two edges having different directions is also 
determined by the sub-pixel precision in the arrow mark 
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direction. After the position alignment in pixel precision 
between the inspection image and the reference image, 
the corners near to each other are set to be the comers 
in corresponding relations, and the position displace- 
ment between the images is obtained from the differ- 
ence of the positions of the comers in corresponding re- 
lations. 

[0065] If no corner exists on the divisional total differ- 
ential image, with respect to a certain edge on the in- 
spection image, and if an edge exists in the region on 
the reference image corresponding to the nearest part 
of the edge, then these two edges are regarded to be in 
the corresponding relations, by which the difference of 
the mutual edge positions is set to be the position dis- 
placement in sub-pixel precision on the direction orthog- 
onal with the mutual edges, the position displacement 
is decomposed in vertical direction and horizontal direc- 
tion, an average value of the position displacements in 
sub-pixel precision of the whole edges in one divisional 
total differential image is obtained individually with re- 
spect to the vertical and horizontal directions, and the 
resultant values are taken as the position displacements 
of the divisional total differential image in sub-pixel pre- 
cision. 

[0066] In the first embodiment, the direction of the po- 
sition displacements of the mutual slanting edges is sup- 
posed to be the direction orthogonal with the edge. Be- 
cause of this, in a case that the edges are not in the 
orthogonal direction, no coordination can be made and 
there is a possibility to make erroneous position align T 
ment. On the other hand, in the second embodiment, 
since the position alignment is effected at the corner 
part, as far as the corner exists, even when the displace- 
ments of mutual slanting edges are in the direction not 
orthogonal with the edge, position alignment can be 
made more accurately. 

[0067] However, in the second embodiment, with re- 
spect to the slanting edge in an optional direction, the 
change in the intensity on the divisional total differential 
image in the direction orthogonal with said edge is re- 
quired to be obtained by interpolating the intensity be- 
tween the pixels. Further, the direction of the edge is 
required to be obtained on each pixel. 
[0068] For example, in a case that the slanting edge 
has an angle of 45 degrees as shown in Fig. 15A, the 
line L1 drawn in the direction vertical to it necessarily 
passes through the center of each pixel value. The point 
f on the line L1 fully agrees with the center of the pixel 
F, and the pixel value of the pixel F can be regarded as 
the intensity on the line L1. However, as shown in Fig. 
1 5B, in a case that the edge is not vertical nor horizontal 
nor 45 degrees, the straight line drawn vertical to the 
edge does not necessarily pass through the center of 
each pixel. Here, assuming the straight line drawn in a 
direction vertical to the edge of Fig. 15B to be 12, in a 
case that the line L2 passes through the pixel G, the 
point g on the line L2 does not agree with the center of 
the pixel G. Consequently, the pixel value of the pixel G 



cannot be regarded as the intensity of the point g on the 
line L2. Therefore, based on the pixel value of the pixel 
in the periphery of the pixel G, the intensity of the point 
g is obtained by relative interpolation method or the like. 

5 [0069] Accordingly, in a case of reducing the calcula- 
tion amount, the first embodiment is preferable. 
[0070] It may be practical to apply first the first em- 
bodiment, and then the second embodiment only to the 
image on which the defect of the object to be inspected 

io has been found. Even in a case that the defect found by 
the first embodiment is a false defect caused by the 
wrong position setting, it can be made clear by the sec- 
ond embodiment which has a higher precision of posi- 
tion alignment that there is no difference between the 

*5 inspection image and the reference image, and that the 
defect detected by the first embodiment is a false defect. 
When the pixels containing defects are less in compar- 
ison with the inspection image, the method of applying 
the second embodiment only to a part of the images re- 

20 quires less calculation amount than the case of applying 
the second embodiment to the whole inspection images. 
[0071] Fig. 2 is a block diagram showing the constitu- 
tion of the third embodiment of the present invention. As 
shown in Fig. 7, the third embodiment of the present in- 

25 vention has a recording medium 1 3 which records a pro- 
gram (automatic visual inspection program) for causing 
a computer to execute the image differential processing 
by the image differentiation unit 2, an image divisional 
processing by the image division unit 3, a pixel precision 

30 position aligning processing by the pixel precision posi- 
tion aligning unit 4, a function fitting processing by the 
function fitting unit 5, a sub-pixel precision position dis- 
placement computation processing by the sub-pixel pre- 
cision position displacement computation unit 6, an ad- 

35 justed differential image forming processing by the ad- 
justed differential image forming unit 7, and an image 
comparison processing by the image comparison unit 
8, as illustrated above. The recording medium 13 may 
be a magnetic disk, a CD-ROM, a semiconductor mem- 

40 ory or other recording medium. 

[0072] The above automatic visual inspection pro- 
gram is read into the image processing unit 9 from the 
recording medium 13, and the image processing unit 9 
executes processing according to the automatic visual 

45 inspection program. 

[0073] According to the present invention, because of 
the position alignment made between the edges, even 
when defects exist in the corner portion, false defect is 
less caused to occur on the edge portion in the vicinity 

so of such comer portion. 

[0074] Further, in the differential images to be com- 
pared, the intensity profile of the corresponding edge 
portions are modified into the same shape, so that even 
if the intensity gradients in the vicinity of the edges differ 

55 between the images to be compared, false defect is less 
caused to occur. 

[0075] Moreover, since the offset which is a DC com- 
ponent in image is lost by differentiation, false defect is 
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less caused to occur even when the offsets differ be- 
tween the images to be compared. 
[0076] Furthermore, since the intensity profile of the 
corresponding edge portions is modified into the same 
shape, even if the gains of the detector or the intensity 
of illumination differ between the images to be com- 
pared, false defects are less caused to occur. 
[0077] Also, in a case of comparing the edge images 
as shown in Fig. 5A, even if the real edge positions differ 
by about the sub-pixel as shown in Figs. 5B and 5C, the 
difference on the edge image by a conventional method 
becomes that of one pixel to become the cause for the 
false defect. Here, Fig. 5A shows an edge image having 
the infinite resolution; Fig. 5B shows an edge image in 
which the edge image of Fig. 5A is expressed by the 
image of 6 X 6 in pixel number; and Fig. 5C shows an 
edge image having the infinite resolution in which the 
edge position is displaced by a sub-pixel by noise ex- 
pressed by the image of 6 X 6 in pixel number. However, 
in a case of comparing the edge profile of the modified 
images following the single peak function form as in the 
present invention, even if the edge positions of the sub- 
pixels differ, due to the small difference of the pixel val- 
ues, false defect is less caused to occur. 
[0078] As reviewed above, since in the present inven- 
tion generation of the false defects can be prevented, 
highly reliable automatic visual inspection can be car- 
ried out. 

[0079] In the present invention, due to the computa- 
tion of the position displacement of the sub-pixel preci- 
sion on each divisional differential image by obtaining 
the distance of the corresponding edges between the 
images to be compared, there is no necessity to make 
comparison by forming magnified images. Accordingly, 
even if the precision of position alignment is elevated, 
no increase in the necessary calculation amount or 
memory capacity should occur. 

[0080] The present invention is not limited to the 
above embodiments but can be subjected to various 
modifications within the scope of the technical matters 
described in the claim. For example, the data of the ref- 
erence image may be processed by reading out from 
the memory device 12 such as a memory to an image 
processing unit 9. 



Claims 

1. An automatic visual inspection apparatus charac- 
terized by comprising: 

an image division differential unit (2) having in- 
puts of an inspection image on the object to be 
inspected and a reference image for making 
comparison with the inspection image, for spa- 
tially differentiating the respective inputted im- 
ages and dividing them into the predetermined 
number of divisions to form the divisional differ- 



ential images; 

a pixel precision position alignment unit (4) 
overlaying the inspection image and the refer- 
ence image by carrying out the position align- 

5 ment in pixel precision which is a pixel size pre- 

cision between the inspection image and the 
reference image on each of the divisional dif- 
ferential image formed by said image division 
differential unit; 

10 a function fitting unit (5) which regards the point 

where the absolute pixel value is larger than the 
predetermined threshold value to be an edge 
in each divisional differential image, obtaining 
the direction of the edge, obtaining the intensity 

is profile of the absolute pixel value in the direc- 

tion orthogonal with the edge, fitting a predeter- 
mined single peak function to it, obtaining the 
maximum value point which is a coordinate of 
the point where its function takes the maximum 

20 value by a sub-pixel precision which is the pre- 

cision lower than the pixel size, and employing 
the resulting value as coordinate of an edge; 
a sub-pixel precision position displacement 
computing unit (6), which functions so that, if, 

25 after the laying over of the images together in 

the pixel precision position aligning unit, there 
is an edge in the region on the reference image 
corresponding to the neighborhood of the edge, 
these two edges are regarded as being in the 

30 corresponding relations, and computing the dif- 

ference of the mutual edge positions as a posi- 
tion displacement of the sub-pixel precision; 
an adjusted differential image forming unit (7) 
for forming the adjusted differential image by 

35 rewriting the pixel value so that the intensity 

profile of the pixel value in the direction orthog- 
onal with the edge should follow the previously 
given single peak type function form on the cor- 
responding two edges; and 

40 an image comparison unit (8) for detecting the 

defect of the object to be inspected by compar- 
ing the adjusted divisional differential image of 
the inspected image with the adjusted division- 
al differential image of the reference image 

45 based on the position displacement of the sub- 

pixel precision of each divisional differential im- 
age computed by the sub-pixel precision posi- 
tion displacement computing unit. 

50 2. The automatic visual inspection apparatus accord- 
ing to claim 1 , characterized in that said sub-pixel 
precision position displacement computing unit (6) 
computes the average value of the position dis- 
placement in sub-pixel precision in all edges in one 

55 divisional differential image as the position dis- 
placement of the sub-pixel precision of said divi- 
sional differential image. 
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The automatic visual inspection apparatus accord- 
ing to claim 1 , characterized in thai the image com- 
parison unit (8) obtains the absolute value of the pix- 
el value by the adjusted divisional differential image 
of the inspection image and the adjusted divisional s 
differential image of the reference image, and in a 
case that the resulting value exceeds the predeter- 
mined threshold value, the unit regard said result to 
be the defect of the object to be inspected. 

10 

The automatic visual inspection apparatus accord- 
ing to claim 1 , characterized in that said image com- 
parison unit (8) forms the adjusted divisional differ- 
ential image having the position displacement by a 
sub-pixel by interpolating the intensity between the is 
pixels in either one of the adjusted divisional differ- 
ential image, and compares it with the other adjust- 
ed differential image. 

The aulomatic visual inspection apparatus accord- 20 
ing to claim 1 , characterized in that the sub-pixel 
precision position displacement computing unit (6) 
detects a corner on the divisional differential image, 
and if a corner exists, the unit effect laying over the 
images in the pixel precision position alignment 25 
unit, after which, if, with respect to the certain corner 
on the inspected image, there is a corner in the re- 
gion on the reference image corresponding to the 
nearest part to said corner, these two corners are 
regarded to be in corresponding relations, and the 30 
difference of the mutual corner positions is comput- 
ed as the position displacement of the sub-pixel pre- 
cision between the corners. 

An automatic visual inspection method comprising 35 
the steps of: 

inputting an inspection image on the object to 
be inspected and a reference image for making 
comparison with the inspection image, and 40 
generating a differentiated images by spatially 
differentiating the respective inputted images; 
generating divisional differential images by di- 
viding the differential images according to the 
predetermined number of divisions; 45 
overlaying the inspection image and the refer- 
ence image by carrying out the position align- 
ment in pixel precision which is a pixel size pre- 
cision between the inspection image and the 
reference image on each formed divisional dif- 50 
ferential image; 

obtaining a coordinate of an edge, by regarding 
the point where the absolute pixel value is larg- 
er than the predetermined threshold value to be 
an edge in each divisional differential image, 'ss 
obtaining the direction of the edge, obtaining 
the intensity profile of the absolute pixel value 
in the direction perpendicular to the direction of 



the edge, fitting a predetermined single peak 
function to it, obtaining the maximum value 
point which is a coordinate of the point where 
its function takes the maximum value by a sub- 
pixel precision which is the precision lower than 
the pixel size and empfoying the resulting value 
as said coordinate of the edge; 
regarding, after the mutual laying over of the 
images, if, on certain edge on the inspection im- 
age, there is an edge in the region on the ref- 
erence image corresponding to the neighbor- 
hood of the edge, these two edges to be in the 
corresponding relations, and computing the dif- 
ference of the mutual edge positions as a posi- 
tion displacement of the sub-pixel precision; 
forming an adjusted differential image by rewrit- 
ing the pixel value so that the intensity profile 
in the direction orthogonal with the edge should 
follow the previously given single peak type 
function form on the corresponding two edges; 
detecting the defect of the object to be inspect- 
ed by comparing the adjusted divisional differ- 
ential image of the inspected image with the ad- 
justed divisional differential image of the refer- 
ence image based on the position displace- 
ment of the sub-pixel precision of each division- 
al differential image computed. 

7. An automatic visual inspection method comprising 
the steps of: 

inputting an inspection image on the object to 
be inspected and a reference image for com- 
parison with said inspection image, and divid- 
ing the respective images according to the pre- 
determined number of divisions; 
spatially differentiating the divided image to 
form a divisional differential image; 
overlaying an inspection image and a reference 
image by carrying out position alignment in pix- 
el precision which is a pixel size precision be- 
tween the inspection image and the reference 
image on each formed divisional differential im- 
age; 

obtaining a coordinate of an edge, by regarding 
the point where the absolute pixel value is larg- 
er than the predetermined threshold value to be 
an edge in each divisional differential image, 
obtaining the direction of the edge, obtaining 
the intensity profile of the absolute pixel value 
in the direction perpendicular to the edge, fitting 
a predetermined single peak function to it, ob- 
taining the maximum value point which is a co- 
ordinate of the point where its function takes the 
maximum value by a sub-pixel precision which 
is the precision lower than the pixel size, and 
employing the resulting value as the coordinate 
of the edge; 
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obtaining sub-pixel precision position displace- 
ment, by, after the laying over of the images to- 
gether in the pixel precision position alignment 
step, if there is an edge in the region on the ref- 
erence image corresponding to the neighbor- 5 
hood of the edge, these two edges are regard- 
ed as being in the corresponding relations, and 
computing the difference of the mutual edge 
positions as a position displacement of the sub- 
pixel precision; 10 
forming an adjusted differential image by rewrit- 
ing the pixel value so that the intensity profile 
of the pixel value in the direction orthogonal 
with the edge should follow the previously given 
single peak type function form on the corre- 15 
sponding two edges; and 
comparing the adjusted divisional differential 
image of the inspected image with the adjusted 
divisional differential image of the reference im- 
age based on the position displacement of the 20 
sub-pixel precision of each divisional differen- 
tial image computed as above. 

A recording medium having recorded a program for 
causing a computer to execute: 25 



after the laying over of the images together in 
the pixel precision position alignment process- 
ing, if there is an edge in the region on the ref- 
erence image corresponding to the neighbor- 
hood of the edge, these two edges are regard- 
ed as being in the corresponding relations, and 
computing the difference of the mutual edge 
positions as a position displacement of the sub- 
pixel precision; 

an adjusted differential image formation 
processing for forming the adjusted differential 
image by rewriting the pixel value so that the 
intensity profile of the pixel value in the direction 
orthogonal with the edge should follow the pre- 
viously given single peak type function form on 
the corresponding two edges; and 
an image comparison processing for detecting 
the defect of the object to be inspected by com- 
paring the adjusted divisional differential image 
of the inspected image with the adjusted divi- 
sional differential image of the reference image 
based on the position displacement of the sub- 
pixel precision of each divisional differential im- 
age computed by the sub-pixel precision posi- 
tion displacement computing unit. 



an image division differential processing having 
inputs of an inspection image on the object to 
be inspected and a reference image for making 
comparison with the inspection image, spatially, 30 
differentiating the respective inputted images 
and dividing them into the predetermined 
number of divisions to form the divisional differ- 
ential images; 

a pixel precision position alignment processing 35 
for laying the inspection image and the refer- 
ence image together by carrying out the posi- 
tion alignment in pixel precision which is a pixel 
size precision between the inspection image 
and the reference image on each of the divi- 40 
sional differential image formed by the image 
division differential unit; 
a function fitting processing so designed as to 
regard the point where the absolute pixel value 
is larger than the predetermined threshold val- 45 
ue to be an edge in each divisional differential 
image, obtaining the direction of the edge, ob- 
taining the intensity profile of the absolute pixel 
value in the direction orthogonal with the edge, 
fitting a predetermined single peak function to so 
it, obtaining the maximum value point which is 
a coordinate of the point where its function 
takes the maximum value by a sub-pixel preci- 
sion which is the precision lower than the pixel 
size, and employing the resulting value as co- 55 
ordinate of an edge; 

a sub-pixel precision position displacement 
computing processing which functions so that, 
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